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Abstract 



Let Xn, ■ ■ ■ ,Xi be i.i.d. random variables with distribution function F. A statisti- 
cian, knowing F, observes the X values sequentially and is given two chances to choose 
X's using stopping rules. The statistician's goal is to stop at a value of X as small 
as possible. Let equal the expectation of the smaller of the two values chosen by 
the statistician when proceeding optimally. We obtain the asymptotic behavior of the 
^ ' sequence for a large class of F's belonging to the domain of attraction (for the 

minimum) 'D{G°'), where G"(x) = [1 — exp(— > 0). The results are compared 
with those for the asymptotic behavior of the classical one choice value sequence V^, 
, as well as with the "prophet value" sequence Vn = E{mm{Xn, ■ ■ ■ ,Xi}). 

(N 

5 ■ 1 Introduction 
in 

O I Kennedy and Kertz (1990, 1991) study the asymptotic behavior of the value sequence, as 
^ ■ n — > oo, when optimally stopping an n long sequence of i.i.d. random variables with common 
c3 ■ distribution function F, with the objective being to stop on as large a value as possible. 
^ ! They show that the asymptotic behavior of the value sequence depends upon the domain of 
^ I attraction, for the maximum, to which F belongs. 

'• Recently Assaf and Samuel-Cahn (2000) and Assaf, Goldstein, and Samuel Cahn (2002) 

■ have studied optimal stopping problems where the statistician is given several choices, and 
^ his return is the expected value of the maximal element chosen. The goals in these works 

were the derivation of "prophet inequalities." 

In the present paper we study the limiting behavior of the value sequence when the 
statistician, knowing F, is given two choices. It turns out to be more convenient here to take 
as objective to stop on as small a value as possible, and therefore to take as the statistician's 
goal the minimization of the expected value upon stopping. In particular, we consider a 
situation where the statistician would like to choose the smallest possible value from the n 
i.i.d variables X„, . . . ,Xi presented sequentially, and, with the luxury of two choices, can 
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take a first choice as a 'fallback' value to use in case that none of the remaining variables 
are small enough to take as a second choice. 

The two choice problem we consider is more difficult by an order of magnitude than the 
optimal one-choice problem. To be convinced of this, let Vjl{x) (which we will also denote 
by gn{x)) and V^{x) be the value of the optimal one and two choice policy respectively, 
when applied to the i.i.d. sequence X„, . . . ,Xi, when the statistician is already guaranteed 
the value x. Note that for convenience we are indexing the variables so that the first one 
observed is X„ and the last is Xi. Then by the dynamic programming principle, for one 
choice Vi{x) = E[Xi A x] and we have 

V;Vi(x)=i?[X„+iAV;'(a:)] forn>l, (1) 

whereas with two choices, ^^(a;) = E[X2 A Xi A x] and, for n > 2, 

V;%(x) = E[V^iX^^,)AV^ix)]. (2) 

The first term inside the square brackets in corresponds to choosing the current vari- 
able X„+i and being left with only one additional choice among the remaining n observations, 
while the second term corresponds to passing up the current random variable X^+i and re- 
taining two choices, with the guaranteed bound x, among the remaining n observations. 

Comparing (jT)) and © we see that for one choice the expectation computed in ([T)) is with 
respect to the random variables X„+i with identical distributions, whereas the distribution 
of the random variable V^{Xn+i) in (j2)) depends on the function which changes with n 
even though the sequence X„, . . . , Xi is identically distributed. 

Let 

Xp = sup{x : F{x) < 1}. (3) 

When nothing is guaranteed, the value for the one and two stop problems will be denoted 
and respectively, and satisfy = Vj^^xp) and = Vj^{xf). 

The optimal stopping rules can be specified in the one and two stop cases by the values 
V^, and the values and functions V^{x), respectively, as follows. For the one stop case, 
if Xn+i is smaller than the variable X„+i should be taken. For the two stop case, if 
Vjl{Xn+i) < then the variable X„+i should be taken as the first choice, and the optimal 
one stop strategy then used on the remaining n variables when there is a guaranteed upper 
bound of Xn+i- In other words, if X^^ has already been chosen as the first choice, then take 
Xm,m < nil as the second choice when X^ < V^_]^(XmJ. 

As in the one choice problem, the asymptotic behavior of the value sequence depends 
on which of the three extreme value classes the distribution function F belongs to. In the 
present paper, we only consider F which belongs to one of these domains of attraction and 
take up the study of the remaining two classes in subsequent work. Specifically in this 
paper, by a suitable shift of the origin, we assume that the distribution function F of the 
i.i.d. random variables belongs to the domain of attraction (for the minimum) 'D(G'"), where 
a > and 

^"^^^ " { 1 - exp(-x") X > 0, 

and satisfies F{0) = and F{x) > for all a; > 0. (This is the Type III of Leadbetter, 
Lindgren and Rootzen, 1983, and Type of Resnick, 1987.) A necessary and sufficient 
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condition for F G V[G°') is 



L(tx) 

Fix) = x"Z/(x), where L(x) is slowly varying at 0, i.e. lim — — — = 1 for all t > 0; 

xio L[x) 

a sufficient (and close to necessary) condition is 

xF'ix) 
lim ^ , , = a, 
xio F{x) 

see e.g. de Haan, 1976, Theorem 4. 

Let be the expected value of the minimum of n i.i.d. random variables. The results 
for the maximum (see e.g. Resnick 1987, Chapter 2.1) and the work of Kennedy and Kertz 
(1991) translate for the minimum as follows: If F G ©(G"), then 

lim nFiyP) = r(l + 1/a)" and 

n^oo 

lim nF{V^) = (1 + 1/a). (5) 

n— >oo 

Our main result for a statistician with two choices is as follows. 

Theorem 1.1 Let Xn, ■ ■ ■ , Xi be non-negative integrable i.i.d. random variables with dis- 
tribution function 

F{x) = x"L(x) where lim^iQ L{x) exists and equals C G (0, oo). (6) 
Then the optimal two choice value satisfies 

lim nFiV^) = /i"(6„) (7) 

n— >oo 

where ba > is the unique solution to 

ry 

h{u)du+ {l/a-y)h{y) = 0, (8) 



and h{y) is the function 



l/a 



\l + ay/{a + l)J 

The value h{ba) depends only on a but unfortunately, unlike the values © cannot be 
given in closed form in terms of a. A short table of the limiting values (0) and of h"{ba) 
are given in Table 1. The performance improvement in having two choices over having only 
one is substantial, in that the optimal stopping value becomes much closer to that of the 
prophet. For example, for a distribution with a = 1 such as the uniform, the limiting values 
(for the minimum) for the statistician with one choice is 2, with two choices it is 1.165. . ., 
while the value for the prophet is 1. More explicitly, with n variables the optimal value for 
a statistician with one choice is roughly 2/n, for the prophet it is roughly l/n, and for a 
statistician with two choices it is 1.165 . . . /n. 
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The paper is organized as follows. In Section 2 we derive some fundamental identities 
when F belongs to the family 



{0 for X < 
for < X < 1 (10) 
1 for X > 1, 

for a fixed value of a > 0; we also show heuristics which explain the form of the function 
h{y) of 0- In Section 3 we show that a particular sequence of functions which determine 
V^j^^^ converges to h. Section 4 contains some general convergence results. In Section 5 we 
prove Theorem 11.11 for the special family (fTTH) . and some results concerning the finiteness of 
the limit of the moments of properly scaled randomly selected values. In Section 6 Theorem 
11.11 is generalized to a wide class of distributions in ©(G"). Section 7 contains numerical 
results presented in Table 1, along with explanations and several additional remarks. 



2 The Fundamental Equations and Heuristics 

In general, for X with distribution function F, we let 

g{x) =E[X ^x\. 

When -F(O) = 0, writing g{x) = x — F{u)du, we see easily that g{x) is positive and strictly 
increasing on the interval (0,Xi?); hence the same is true for gn+i{x) = g{gn{x)). 

In the remainder of this Section we consider F = as in (fTIH) . and in all the following 
we consider a > as fixed, to avoid the necessity of indexing quantities by a. For we 
have explicitly on the interval [0, 1] 

g{x) = E[X A x] = X - (11) 

and with gi{x) = g{x), 

gn+i{x) = gn{x) - ^""^^K , n>l. (12) 
a + 1 

Since a statistician with two choices does at least as well as one with a single choice 

9n{0) = 0<V^<V^ = gn{l), n>2. 

As we are interested in the two choice case, we will henceforth write Vn to denote whenever 
convenient. Because the function g^ is strictly increasing on [0,1], there exists a unique 
number 6„ G [0, 1] satisfying 

Vn=gnibn). (13) 

We call bn the "threshold value" for the following reason; by (j2I) the statistician at stage 
n + 1 will choose when gni^n+i) < Vn, that is, when < 6„. 

Since 6„ G [0, 1], P{X > 6„) = 1 — 6^, and the basic equation © becomes 

Vn+i= / gnix)ax"-'dx+{l-b^)Vn, n>2. (14) 

^0 
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Letting Uk be independent W[0, 1] variables, Ul^" has distribution W", and hence we may 
begin recursion (HI at ^2 = A t/i^"]. Scahng, 

W„ = = n'/'^bn (15) 

and 

gn{x) = xfn{nx°'). (16) 

Since gn{,x) is defined and positive for < x < 1, the function /„(x) is defined and positive 
for < a; < n, and setting /„(0) = 1 makes fn{,x) continuous as a; | 0, since ^'^(O) = 1. 
Substituting ()16p into (fT^ and making the change of variable y = nx°' we obtain 

K+1 = n-(^+i/") / y'/Vn{y)dy + (1 - 6^)V;, n > 2. 



Multiplying by n^/" and setting 

/^n(i/) = y'^'^fniy) (17) 

we have 

^ Wn+i = - K{y)dy+{l-b':)Wn, n>2. (18) 
By (IISl),(IISl),(IinD and (HH), 

iy„ = h^B^) (19) 
and we can now write (fTBj) as our fundamental equation 

n \ '^^ 1 



W„ = c and — — Wn+i = - / (/i„(?/) A iy„) rfy for n > m, (20) 

with m = 2 and c = 2^/°'i?[[/2^" A Ul^"]. Later we allow for arbitrary initial times m > 1 
and any positive starting values c. 

The remainder of this Section is devoted to a heuristic argument explaining ((Tj) and (jSj), 
the appearance and form of the function /i in (jU)) and of Theorem ll.il Firstly, ((n+ 1) / n)^/" = 
1 + l/{an) + 0(n~^), and if 5" and the integral below remain bounded, we have from (fTHjl 

Wn+i-Wn = n-^ / K{y)dy + n-\l/a- B^)Wn + 0{n-^). 
Jo 

If Wn — >■ da such that Wn = da + ain + 0{n~'^), then n{Wn+i — Wn) 0, and multiplying 
by n we have 

/ n 

0= / /i„(y)d2/+(l/a-K)^n + o(l), (21) 



and if — > 6^ and hn ^ h as n ^ 00, then (|7H) suggests 

= / h{y)dy+{l/a-ba)do 



where from ()19|) also 
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which explains (|7j) and (jHl) of Theorem 11.11 

By ()17|) . finding the hmiting h is equivalent to finding the limiting /, since 

h{y)=y"y{y). (22) 

Using ()12j) and ()lfi|l and the substitution y = nx", it follows that 

/„«((! + i).) = AM -^/„(yr«. (23) 

Subtracting fn{y) from both sides, dividing by y/n and taking limits as n — > oo indicates 
that the limiting function / should satisfy the differential equation 

f'{y) = -f(y)'^+^/(a + 1) with initial condition /(O) = 1. (24) 

Equation has the unique solution 

f{y) = (1 + ^)-^/", (25) 

a + 1 

which together with (j^^ yields the function h of 

3 Preliminary Lemmas 

In this Section we continue to consider F = U" as in ((TU)). With as in (fTB|) and hn as in 
(II 7p . we have the following Lemma. 

Lemma 3.1 The function fniy) is strictly decreasing in y fory G [0, n] and hn{y) is strictly 
increasing in y for y G [0, n]. 

Proof: We prove the lemma by induction on n. For n = 1 from (|TT|l and (fTHI) 

y 



fi{y) = i- 



a + r 



so the result is immediate for /i, and for hi by ()17|). Now assume the assertions are true for n. 
We shall show they are true for n+1. Note that for < y < nwe have < y{n+l)/n < n+1. 
Differentiating (j23|) . for < y < ra, 



^V^+i^^^) = fniy)-r^^fniyr^'--my)fniy) 

n J n [a + l)n n 

= AMii-:^/„"fe)i-^/.ter' 

< 0, 

where we have used f'^iy) < and < /"(y) < 1 for < ?/ < ra. 
From ()23p and ()17|) we have 

' )^/"/l„+l(^t/) = /l„(l/)- , /^n(y)°+^ 



n + 1 n (a + Ijra 



Thus for < ?/ < n we have 

since by the induction hypothesis h'^{y) > and 
Let f{y) be given by and define 

en{y) = f{y)-Uy)- (26) 

Lemma 3.2 With en{y) as in / f^) . 

e„(y)>0 forO<y<n. (27) 
Proof. We use the following two well known inequalities. 

For < a < 1 and X > -1, (1 + a;)" < 1 + ax, (28) 

and 

for a > 1 and a; > -1, 1 + ax < (1 + x)°. (29) 
We prove the lemma by induction. For = 1 we must show that for < y < 1 

1 - ^ < (1 + ^)-/" 
a + 1 ^ a + 1^ 

which is equivalent to 



-<(1 + ^1^)-1 



a + 1 a + 1' 

or 

(i + ^)(i-^r <i- (30) 

a + 1 a + 1 

Now for < a < 1 we have by that the left hand side of (piUl is less than or equal to 

a+1 a+1 a+1 
For a > 1 the left hand side of (j3(J|) is by (j29|) less than 

(1 + )"(i ^)" = [1 - (^— )Y < 1. 

^ a + 1^ ^ a + 1^ ^ ^a + r ^ 

Thus ei(?/) > for < y < 1. 

Now suppose en{y) > for < y < n. That e„+i(?/) > for < ?/ < n + 1, is equivalent 

to 

/n-fi(l/)<(l + ^)-^/" 
a + 1 

By the induction hypothesis 



Uy) < (1 + ^)-^/" for < y < n 
a + 1 



and thus by (fT^ 

gJx) < xil + for < X < 1, 

a + 1 

and since g{-) is an increasing function, using (fT^ . 

Thus, again by ()16|) . it suffices to show that the right hand side of (jHT|) is less than 

+ + forO<x<l. 
a + 1 

Set y = x"/ (a + 1). Then it suffices to show that 

(1 + - Y^^^] < (1 + + 1)?/)"^^" for < ?/ < 1, 

i.e. that 

[1+ " ]<1, 

1 + any 1 + any 

which is equivalent to 

[1+ ][1 ^ f < 1. 

1 + any 1 + any 

For a < 1 use to get that the left hand side of (jH^ is less than or equal to 

[1 + ][1 - ] = 1 - ( )^ < 1. 

1 + any 1 + any 1 + any 

For a > 1 use to get that the left hand side of (jH^ is less than 

[1 + — - — — 1" = [1 - ( — - — fr < Im 

^ 1 + any' ^ 1 + any' ^ ^1 + any^^ 



Lemma 3.3 With en{y) as in 

y 

(^n{y) < — forO<y<n. 
2n 

Proof: We prove by induction. For n = 1 we must show that 

(l + ^)-i/"<l-y(^-l) forO<y<l. 
a + 1 a + 1 2 

> 1, equation (j3l|l is obvious, since the left hand side is less than 1 and the right 
i greater than 1. For a < 1 we have, by that 

(1 + ^)V«>1 + ^. 
a + 1 a + 1 

Thus to show (j34j) it suffices to show 

1 y{l - a) 

1 +y/(a + 1) ^ ^ ~ 2(a + l)' 
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For a 
side is gi 



i.e. that 

^ a + r^ 2{a + iy 2 2(a + 1)2 

which clearly holds for < ?/ < 1. 

Now suppose (jH^ holds for n. Let < y < n + 1, and p„ = n/(n + 1). By 

en+i(y) = f{y)-fn+i{y) 

= f{y) - fniPny) + j^^UPnyT^' 

[a + \)n 

= UXy) - fiPny)) + ifiPny) - fniPny)) + 7 — — r-^fn{PnyT^^- 

[a + lj[n + 1) 

Thus 

^n+liy) = f{y) - fiPny) + ^n{Pny) + 7 — T/n(Pn2/)"'^^- (35) 

[a + 1)(?7. + 1) 

Note that 

/'(!/) = -/(l/r+V(« + l)<0 fory>0 (36) 

and 

/"(?/) = /(l/)'°+V(« + l)>0 fory>0. (37) 
Thus if we use the Taylor expansion 

f{x + A) = f{x) + A/'(x) + -7^f"{x + ^A) for some < ^ < 1 
with X = pny and A = y/{n + 1) so that x + A = we get, by use of pUj) and P7j) 

f{y) - fiPny) = ^.J iPnyr^' + ^, ^.f. /(%)^"+^ (38) 

(Q; + l)(n + l) 2(« + l)(n + l)2 

where p„ < < 1. Substituting (jHH|) into (jS^ yields 

2 

(« + l)(n + l) 2[a + l)[n + lY 

(39) 

Since by (|27|) /(p„?/) > fniPny) for < y < n + 1, we have 

/(Pn2/)"+' - fniPnyr^-' > f {Pnynf (Pny) " /„(Pnl/)] = /(Pnl/)"en (Pnl/) • (40) 

Substituting (gOD into (jSHD yields 

2 

6„+i(y) < 6„(p.y)[l - I ^.J iPnyT] + ^, ^Z f{Oyf-+\ (41) 

(a + l)(?2 + l) 2(« + l)(n + l)^ 

It follows from the induction hypothesis that for < ?/ < n + 1 (so that < pny < n) 

( ^ ^Pny y 



9 



Thus dHJ yields 



2 

'-^'^y^ < W^)^' - (a + l){n + 1) ^^^"^^"] + 2{a + l){n + ly ^^^^^' 

^ y i//(Pni/)"{i-/(%)"+^} j , y 



2{n+l)' (a + l)(n + l) ' 2(n + l)' 

where we have used the fact that / is decreasing, 9 > pn, and / < 1. ■ 

Corollary 3.1 

fniy)-^fiy) = (1 + ^)-^/" forally>0,asn^^ 

a + I 

f y V^" 

hn{y) h{y) = (^ ^ _^ ay /{a + 1) J '^^^ 1/ > 0' as n ^ cx). 
Remark 3.1 Note that by and (OJj 

/z„(n) = ni/"^„(l) = n'/^V^ 

and thus, by ^ 

lim h^{n) = + 

n— >oo 

On the other hand, we also have 

lim h{y) = [1 + 

y-*co 

Thus, the convergence to h in Corollaru VJ. 1\ satisfies 

lim hn{n) = lim lim hn{y)- 

n— >oo J/— >oo n— »oo 

4 Convergence of Recursions 

To prove convergence of the sequence Wn determined by the recursion (pUj). we first study 
the behavior of a sequence Zn, whose values are given by the simpler recursion 

/ n 1 r 

Zm = c and — — Z^+i = - {q{y) A Zn)dy for n > m, (42) 
\n + lj uJq 

where the function in the integral does not depend on n. 
For a > a fixed value and g(-) a given function, define 

Q{y) = r q{u)du + (l/« - y)q{y). (43) 

We prove the convergence of Zn under the following conditions: 

(i) g(0) = 

(ii) q{u) for < m < oo is non-decreasing everywhere and strictly increasing and differentiable 
for Q < u < A where 1/ a < A < oo. 

(iii) There exists a unique positive root 6 G (l/a, A) to the equation Qiy) = 0. 
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Lemma 4.1 Under conditions (i) and (ii), the function Q{-) is strictly increasing for < 
y < l/a, strictly decreasing for 1/a < y < A, and non-increasing for A < y. Hence 
Q{A) = liiiiyiA Q{y) exists and is in [—00, 00), even when A = 00, and (Hi) holds ifQ{A) < 0. 

Proof: For < yi < y2 < ^/<y straightforward calculations yield 

Q{y2) - QiVi) > {q{y2) - q{yi)){l/a - y^), 

and for l/a < 2/1 < y2, 

Q{y2) - Q{yi) < (^(2/2) - - yi)- 

The claims now follow directly. ■ 

The main result of this Section is 

Theorem 4.1 Let (i), (ii) and (Hi) hold, and let Zn he given by l{4^ with m > 1 any integer 
and c G (0, oo) any constant. Then the limit of Zn exists and 



lim Zn = d, 

n—*oo 



where d = q{b) with b the unique root of Q{y) = 0. 

Lemma 14.21 is the crux of of the proof of Theorem 14.11 

Lemma 4.2 Assume that (i), (ii) and (Hi) hold. Let m > 1 be any integer and c G (0, oo) 

any constant, and suppose that Zn for n > m is defined by Then for every 6 G 
(0, mm{q{A) — d,d — q{l/a)}) there there exists A > and hq such that for all n > hq, 

if Zn<d-S then Zn+i > (1 + A/n)Z„, (44) 

zf Zn> d + 5 then Zn+i < (1 - A/n)Z„, (45) 

if Zn < d then Zn+i < d, and (46) 

if\Zn-d\<5then\Zn+i-d\<5. (47) 



Proof: We have 



and hence for 7 > 



n an a a Iw^ 



^ - = 1 - r(- - -) + i (i(- - 1) - :^ ) + 0,.,(n-% (48) 



n n^y n a \2a a a^y 

where we write Ox{fn) to indicate a sequence bounded in absolute value by /„ times a 
constant depending only on A, a collection of parameters. 
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Define ^ 

M(t) = (^1- dy for < t < q{A). 

From pnjl . = and d = we liave 

M(d) = 1/a. 

It is not liard to see tfiat M{t) is strictly increasing over its range. Hence, setting Ai = 
(1/a - M{d - 6))/2 and As = {M{d + 5) - l/a)/2 we liave A = min{Ai, A2} > 0. Now 
consider tlie function 

Since > we have Z„ > for all n > m, and now by (j42j) we have 

/n + 1\ ^/'^ 

Z„+i/Z„=f— — j r„(Z„). (49) 



By definition 



rJt) = 1 - -M(t) for < t < g(n) 
n 



To prove (jUJ, assume Zn < d — 6. Since r„ is decreasing, using and PH|) . we have 
for all n > q^^{d — 5), 

n 

= Z„(^)i/"(l--M(ci-5)) 
n n 

= (i + l(l_M(rf-5)) + 0„,,_5(n-2))Z„ 

> (1 + > (1 + 

n n 

for all n sufficiently large, showing 

Next we prove ()45|) . When Z„ > c/ + 5, we have similarly that for n > q~^{d + S), 

Zn+i < Z^{^Y/^r^{d + 6) 
n 

= Z„(!i±l)V-(l-lM(rf + 5)) 
n n 

= (i_i(M(rf + 5)-i) + 0„,,+5(n-2))Z„ 
n a 

< (1-^)Z„< (1--)Z„ 
n n 

for all n sufficiently large. 
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Turning now to and (jUj), for Zn < d + 6, since d + 6 < q{A), [3n is well defined by 

q{(3n) = Zn. 

Now by (021) and 



n 1 / r^" \ 1 1 

Zn+l = -( q{y)dy +{n- Pn)q{Pn) = -QiPn) + (1 )Zn, 

n \Jq J n an 



n + l 



thus 



where 



Consider 



/ 1 \ 1 

Zn+l = 1 + - -Q(^n) + RnZn (50) 

\ n J n 

i?n = (1 + -—). (51) 

n an 
Q{q-\u))= / q{y)dy+{l/a-q-\u))u. 



Since g ^{u) is differentiable for < m < (/(A), 

±Q{q-\u)) = l/a-q~\u). 

Hence, evaluating Q{q~^{u)) by a Taylor expansion around c?, and using Q{h) = Q{q^^{d)) = 
0, we obtain that there exists some ^z„ between d and Z„ such that 

QiPn) = Q{q~\Z^)) = (Z„ - d)il/a - q'\^z„)). (52) 
Subtracting d from both sides of (j5(J|) and using (|52|) we obtain 

Zn+l - Ci = |l - (1 + -)'/"-(g"'(ezJ - -)| (^n - C?) + [i?n " Ij^n- (53) 

Take ni such that for all n > ni 

n n 

Then for Zn < d we have < (i and hence q~^{C,z„) < q^^{d), and so 

0<|i-(i + -)^/"-(g-^(ezJ--)|. 

l_ n n a ) 

Hence the first term on the right hand side of is strictly negative. Next, there exists 
n2 > ui so that for n > n2 we have < < 1, by ()51|) and ()48p with 7 = a. For such n 
the second term on the right hand side is also negative, and the sum of these two terms is 
therefore negative. This proves pUj) . 

To consider (|T7|) suppose that \Zn — d\ < 6. Then \C^z„ — d\ < 6, and therefore 

q~\d-6)<q-\^zJ<q-\d + 6). 
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Hence, for all n sufficiently large so that 

n n 

letting A3 = q^^{d — 5) — 1/a, which is strictly positive by choice of 5 < d — qilja), we have 
q^^{izn) — > A3 and therefore 



o<(i-(i + -)^/"V^(aJ--)| < 1-^ 

[ n n a ) n. 



(54) 



< 


(1- 


A3 






n 


< 


(1- 


A3 






n 


< 


5. 





Further, from (j5T|l . again using P8|l with 7 = a, there exists Ka such that 

\Rn-l\ < 

Then for all n so large that 

— (rf + <5) < A35 
n 

we have, using and (jHH), 



)5 + ^(d + <5) 



This proves (jUj). ■ 

Proof of Theorem I4.lt For 5 E (0, min{g(y4) — d,d — q{l/a)}), let A and Uq be as in 
Lemma 14.21 

Case I: Z„q > d + 6. If Z„ > d + 5 for all n > no then by we would have 

" A 

Zn+i < n (1 - ^ 0, 

J=no 

a contradiction. Hence for some rii > uq we have < ci + 5, and we would therefore be in 
Case II or Case HI. 

Case II: < d — 6 for some ni > no. If Zn < d — 6 for all n > ni we would have by 
(gH) that 

" A 

^n+l > TT (1 + — )^ni ^ 00, 
J 

a contradiction. Hence there exists n2 > ni such that > c/ — 5. By (I46p . < (i, 
reducing to Case HI. 

Case HI: — (i| < 5 for some ni > no. In this case \Zn — d\ < 6 for all n > ni, by ()47|) . 
Since 5 can be taken arbitrarily small, the Theorem is complete. ■ 
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The following Lemma may be of general interest, and presumably has been noticed 
independently by others. We will apply it to obtain asymptotic properties of moments in 
Section El 

Lemma 4.3 A. Let Dn, n > uq be a non-negative sequence satisfying 

Dn+l < l^nDn + In, n> Uq, (55) 

where 

(J 

< < (1 - ^/n) and < 7„ < - 

n 

for some d > Q and C > 0. Then 

limsup Dn < oo. 

n— >oo 

B. Let > and let 

Dn+l > ^nDn + 7n, n > Uq, (56) 

where 

'&n> i^ + i^/n), and 7n > 0. 

for some -i? > 0. Then 

lim Dn = OO- 

n— >oo 

Proof: Consider A. If fj55|) holds, then by induction, for all n > hq and k > 0, 



(n+k \ n+k / n+k \ 

j=n / j=n \l=j+l / 



Using < (1 — 'd/n) and 1 — x < e ^ we have 

n+k n+k 

n < n ^ ' ^ 

i=j+i i=j+i 

n+k 

= exp(-^ Yl 
i=j+i 

< exp(— 'i9(log(n + k) — log(j + 1))) 
J + 1 



n + k 

Hence, from (j57p . for all A; > 0, 

/n+k \ n+k / n+k 

Dn+k+1 < n^O + E n ^0 



Kj=n / j=n \l=j+l 

n+k 

< D„ + Y, 



n+k / . 1 \ 1? ^ 



j=n 



n + k J j 



^ "^^^^n + ky^^ 

j=n 



< D 



2^C /n + k + l^^ 



\ n + k 
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(57) 



Letting A; ^ oo we see that the Z)„ sequence is bounded. 

To prove B, note that > for all n > Uq and that for all j sufficiently large 

^j>{l + ^/j)>exp{^/{2j)), 

which gives, by (jSEI), 

D„ ,i, .i > I I I ^9,- 1 -D„ > expf^ "S " -)Dr, ^ oo as ^ oo. 



^n+k \ ^ n+k ^ 

n ) > exp(- -)Dn ^ OO 

\j=n / j=n ^ 



la 



5 The Family W 

As in (gni), with h{-) defined in Q, let 

ry 

H{y)= / h{u)du+{l/a-y)h{y)- 



Jo 

note that h{-) is strictly increasing for < ?/ < cxd. 

Lemma 5.1 There exists a unique value ha > l/a such that H{ba) = 0, and 

/i"(6„)<l + -. (58) 
a 

Proof: By Lemma l4.ll H{y) is strictly increasing for < y < 1/a and strictly decreasing 
for 1/a < y < oo. Hence a root exists in {1/a, oo) and is unique if H is ever negative. Since 

H'{y) = {l/a-y)h'{y), 

for some constant a 

ry 

H{y)=a+ {l/a-u)h'{u)du. (59) 

Jl/a 

Now, since h{y) converges to a finite positive limit at infinity, and 

h'{y) = -hiy)'-'^ ^ 



a (1 + a?//(a + 1))2' 

we have that y^h'{y) is bounded away from zero and infinity as y —>■ oo, and therefore 

/ h'{u)du < oo and / uh'{u)du ^ oo as ?/ — > oo, 

Jl/a Jl/a 

yielding from that 

lim H{y) = — oo. 

y^oo 

Inequality ()58j) follows from limy^oo 

/i°(y) = 1 + 1/a . ■ 

For /(?/) as given in (|^. setting 

f;iy) = f{y)-y/2j (60) 
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we have 



Since yf{y)'^ is strictly increasing with hmit + at infinity, f{y)/a > y f (y)"'^^ / {a + 1) 
for all y > 0. Hence, for any fixed A > ba "we have 

o<?/<A \ a a + 1 J 

It follows that there exists jo = Jo(^) such that the derivative in (jUT|) is positive for all 
< y < A and all j > jo- For these j, set 

k(v)-l y"y^^y^ foro<y<A 



and 



Kj{y) = I kj{u)du + (1/a - y)kj{y). 



Lemma 5.2 There exists ji such that for all j > ji there are unique roots bj^a to Kj{y) = 
and bj^a > Setting dj^a = kj{bj^a) we have 

bj,a ba and dj^a ^ da as j ^ oo, where da = h{ba) ■ (63) 

Proof: We apply Lemma l4.ll The functions fcj(-) satisfy kj{{]) = 0, are non-decreasing 
everywhere and are strictly increasing and differentiable for < y < A. Further, kj{y) 
converges uniformly to h{y) in [0,^4], yielding the uniform convergence of Kj{y) to H{y) in 
[0, A]. Since H is strictly decreasing in (1/a, oo), it follows that H{A) < H{ba) = 0. Hence, 
since Kj{A) H{A) as j —>■ oo, for all j sufficiently large Kj{A) < 0. For such j Lemma 
14. II now yields the existence of a unique root bj^a > 1/a satisfying Kjibj^a) = 0. 

The uniform convergence of Kj to H implies H{bj a) — > as j — oo, from which the 
convergence of bj^a to ba follows. That dj^a converges to da follows from the uniform conver- 
gence of kj to h in [0, A]. ■ 



Lemma 5.3 Let m > 1 be any integer and c G (0, oo) be any constant. For n > m let Wn 
be determined by the recursion i2U\} with starting value Wm = c, and let 



^ \ ' ^ 1 



Z+ = c and i^j) ^++1 = -/ {hiy)AZ^)dy forn>m. (64) 
\n + i/ n Jo 

With ji as in Lemma \E~R for all j > ji let m* = max{m, j}. Now define sequences for 
n > m*, by 

= ^rn* and y-^j ^lu^^ = -J^ {kjiy) A Z'J dy for n > m*. (65) 
Then for all n > m*, 

<Wn<Zt (66) 

and 

lim Z~^ = dj^a and lim Z^ = da- (67) 
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Proof: With j > ji and f* defined in flUnj) . Lemmas 13.31 13.21 and monotonicity of fn give 

fjiy) < fniy) < fiy) for all n > j and O < y < n. 
Therefore, by (fTTjl and (^j) . 

kj{y) < hniy) < h{y) for all n > j and < y < n. 

Equation (jUUj) now follows by a comparison of (pUj) and and (jUTjl follows directly 
from Theorem 14.11 ■ 

It is convenient to consider the value and scaled value arising from stopping a sequence 
Un"", • • • , U^"i,Xm, Xm-i, . . . , Xi of independent variables with a finite initial subsequence 
from a distribution other than that of f/^/". The scaled value sequence for this problem 
satisfies fOUj) with c = m}/"Vm{Xm, ■ ■ ■ , Xi). Note that for any m and c there exists 
Xm, . . . ,Xi such that c = m^/°'Vm{Xm, ■ ■ ■ ,Xi); the simplest construction is obtained by 
letting Xj = cm~^/°' for 1 < j < m. Our suppression of the dependence of Wn on m and c is 
justified by Theorem 15. H which states that the limiting value of Wn is the same for all such 
sequences. 

Theorem 5.1 Let m >2 be any integer and suppose the variables Un"' , . . . , U^^i,Xm, . . . ,Xi 
are independent. Let 

Vn,m = VniUl^"", . . . , U^^i, X^, • • • , -^l), (68) 

be the optimal two choice value, and suppose Vm{Xm, ■ ■ ■ ,Xi) = c G (0, oo). Then 

Wn = n^/°K,m for n> m, 

satisfies 

lim Wn = hiba), (69) 



n— >oo 



where ba is the unique solution to (0)- 

In particular, the optimal two stop value Vn for a sequence of i.i.d. variables with distri- 
bution function W^i^x) = for < x < 1 and a > satisfies 

lim nW"(K) = /i"(&a); (70) 

n— >oo 

that is, the conclusion of Theorem M . 1\ holds for the family of distributions. 

Proof: We apply Lemma 15.31 with the given m and c. Letting n — cxd in ()66p and using 

(EH), 

dj^a < hm inf Wn < lim sup Wn < for all j > ji . 

Now letting j ^ oo and using (jU^ gives (jHH). The Wn values for the i.i.d. sequence with 
distribution function are generated by recursion (j2(Jj) for the particular case m = 2 and 
c = 2i/"E[f/2/° A f/y°], thus proving m 

We conclude this section with some results on the existence of moments for both the one 
and two-stop problems. 
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Theorem 5.2 Let Un'^ , . . . , t/^" he an i.i.d. sequence with distribution function W", a„ a 
sequence of constants in [0, 1] with = 1, and 

Tn = max{l < k < n : Ul^" < ak-i}- (71) 
When An = n^l^an satisfies 

< K = lim inf < lim sup A^ = k<oo 



we have 
If 

we have 
Proof: Let 



lim sup E{n^/'^U]!^y < oo for all r < ok". (72) 



K < OO, 



lim E{n^/''U]!^y = oo for all r>aK^. (73) 



be the r^^ moment of the stopped sequence. The sequence M„(r) satisfies the recursion 



Mn+iir) = I (1 -a°)M„(r), n > 1. 

Substituting y = nx", 

M„+i(r) = r\^/-dy+{l-al)M^{T). 

J 

Multiplying by ra''/", and letting n^^°'Mn{r) = Sn{r), 

5„+i(r) = - / f/'^dy + il-^)Snir) 



n + 1 J n In n 



n{l + r/a) n 
To show (f7^. multiplying (fTij) by ((n + l)/nY^" and noting that 



/la+r AO 

'l-^)S„ir). (74) 



= 1 + — + 0,/<,(n 2) 

n J an 

by the boundedness of the sequence An and k." > r/a, we obtain for all n sufficiently large, 

nr/a Aa+r ( — r I ni\ 

Sn^dr) < ' , + (1 - ^ % ^ O gn(r); 

n(l + r/aj /n 

()72|) now follows from Lemma f4.3l A. 

To show (fTSj) we note that for all n sufficiently large, using (f7^ . 
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n n 

= {l + ^ + Or,a{n-')){l~^)Sn{r) 
an n 

1 + + Or,^f,{n-')\ SJr) 

Now, recalling that r/a> k", apply Lemma f4. HI B. 

Corollary 5.1 Let 1^^''" and 2^^^^" he the one and two choice random values obtained from 
optimally stopping an independent sequence of variables having distribution W". In the one 
choice case, 

ifr <l + a, limsupE(n^/"lf ''")'^ < oo, (75) 

n— >oo 

while ifr>l + a, \imsup E{n^^"ll^^^"y = oo. 

n^oo 

In the two choice case, 

ifr<l + a, lim sup E(n^/"2f < oo. (76) 

n— >oo 

Proof: For one choice, apply Theorem 15.21 with a„ = V^^, and therefore U^^" = 1^^'^". By 

lim n^/"1/^ = lim (nW"(V„^))^/" = (1 + l/aY^"- 

n—*oo n^oo 

The one choice results now follow from (f?^ and (f7S|) of Theorem 15.21 with k = k = (1 + 
l/o;)!/". 

For two choices, let T!„ be defined as in (17111 with 6„, the first choice thresholds given in 
(fT!?jl . replacing a„, and let Bn = n^^^bn- Then as 2^^''" < U^^^"" , it clearly suffices to show 
that for r < 1 + a, 

limsupE(ni/"f/^f")" < oo. 
Reiterating ^,Wn = hn{B^), and by Theorem O 

lim Wn = da = h{ha)- 

n— >oo 

We show lim^^oo B'^ = ha- Suppose limsup^^oo = 5" > ha- Then there exists e > 
such that 5" — e > 6q,. But then limsup„^oo /i„(i?") > limsup^^o^ ^n(-B" — e) = h{B"' — e) > 
h{ba), a contradiction. Similarly if liminf„_^oo -B" < ba- Thus the limit of Bn exists and 

n^/"6 = B ^ 6^/" 
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By (f?^ it suffices to show that ba > 1 + l/a, which, by Lemmas 14. II and 15. 11 would follow 
from H{1 + l/a)> 0. Now 



H(l + l/a) = (1 + a) 



i/q 



> (l + a)i/° 
= 0, 



1+1/q / 

\a + 1 + ay 
1 



2(l + a] 



y 



l/a fl+l/c 



1/a 



dy 



y'/^dy 







1 + 

2(1 + a) 

l + l/g y/" 
2(1 + al 



completing the proof. H 

Remark 5.1 Kennedy and Kertz (1991, Theorem I.4) obtain the limiting distribution of 
the scaled optimal one stop random variable v}l°''\^ " . It is easily checked that this limiting 
distribution has a finite r^^ moment if and only if r < 1 + a, which is not surprising, when 
compared with fT^D in Corollaru \5.1\ 

Remark 5.2 From the proof that 6a > 1 + l/a m Corollaru \5. 1\ it follows that the limiting 
thresholds bn for the first choice in the optimal two-choice problem are larger than the corre- 
sponding values VjI for the optimal one choice problem, for all a > 0. This is reasonable, as 
with two choices one 'can afford' to make the first of the two choices in the two stop problem 
earlier than the only choice in the one stop problem. 

Another interpretation of the inequality bn > is gained by applying V^^O to both sides, 
to obtain Vn > Vin ^'^^ ^■^ better off having one choice among 2n variables than having 
two choices among n variables. 

Remark 5.3 Whereas it follows from Resnick, (1987, Proposition 2.1) that all scaled mo- 
ments of the minimum exist, it is of interest to note that no moment with r > 1 + a exists 
for the optimal scaled one-choice value. 



6 Extension to General Distributions 

Theorem 15. II treats the special case where the variables have distribution function U'^{x) as 
in (jlUj) . At the end of this section we prove Theorem 11.11 for an i.i.d. sequence of random 
variables in a much wider class. 

To prove Theorem 11.11 the two stop problem is considered for ...,Xi, non-trivial 
independent but not necessarily identically distributed random variables. It is direct to see 
that the dynamic programming equations given in the introduction for an i.i.d. sequence 
hold under the assumption of independence alone. In particular, the one and two stop value 
functions V^{x) and V^{x) are again given through (jT} and ^ respectively. With nothing 
guaranteed, we have that = V^^(oo) and Vn = V^{oo) are the one and two choice optimal 
stopping values, respectively. However, Lemma 16.11 gives an alternative representation for 

which reduces to V^{xf) as given earlier for the i.i.d. case, as well as conditions which 
guarantee that the 'threshold' indifference sequences are uniquely defined for independent 
but not necessarily identically distributed sequences. 
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Lemma 6.1 Let Xn, . . . ,Xi be non-negative independent random variables with distribution 
functions F„, . . . ,Fi respectively, and xp given in Then for all x > the function Vi!^{x) 
given by (OJj satisfies < Vj^{x) < x and is non- decreasing and continuous. 
Letting vi = xpi and 

Vk = Vk-i A Wk where Wk = mi{y : Vj^_^{y) > XpJ for2 <k <n, 

the function V^{x) is strictly monotone increasing for < x < Vk, and satisfies (x) = 
Vi}{vk) for X > Vk; in particular 

Vk' = V,\vk). 

Furthermore, the indifference numbers b^, 2 < k < n given by the solutions to 

Vk = V,\b,) 

exist, and are uniquely defined in [0,^^]. 

Proof: For all a; > the function V^^x) = E[XiAx] = x—J^ Fi{y)dy satisfies < V^^x) < x 
and is non- decreasing and continuous; further, V^^x) is strictly increasing for x in [OjXiT'J, 
and Vl{x) = EXi for x > xp^- Now assume for all a; > that < V^_^{x) < x, and Vj}_^{x) 
is non-decreasing and continuous. Then (x) = E[Vf!'_i{x) A Xk] < E[x A Xk] < x. For 
< X <ywe have V^{x) = E[V^_^{x) A Xk] < E[V^_^iy) A Xk] = V^{y), and V^{x) is 
continuous for all x by the bounded convergence theorem, using the continuity of V^^_x(a^) 
and its upper bound of x. 

To prove strict monotonicity, assume that is strictly increasing for < x < Vf^^i 

and take < x < y < Vk- Since Vk < Vk-i we have V^_^{x) < V^^_i(y), and since x < Wk we 
have V^^_]^(x) < xp^ and therefore P{Xk > V^_^{x)) > 0. Hence 

V,\x) = E[V,Uix) A X,] < E[V,'_,iy) A Xk] = V^{y). 

Now, assuming that Vj^_^{x) is constant for x > Vk-i, then for all x > Vk-i, 

V.'ix) = E[V,Uix) A Xk] = E[V,Uivk-i) A Xk] = E[V,'_,ivk-i) A xp, A Xk] 
= E[V,U{vk-i) A V,\,{wk) A Xk] = E[V,U{vk-i A Wk) A X,] = V,\vk). 

Similarly, for all x > Wk, 

V,\x) = E[V,'_,ix) A X,] = E[Vl,{x) A Vl,{wk) A X,] = E[Vl,{wk) A X,] = V,\wk), 

from which it follows that = Vi}{wk) and (x) = V^^(ffc) for all x > Vk- 

Since 

= V,\0) <Vk = V,\bk) < = V,\vk), 

and Vi}{x) is continuous and strictly monotone increasing in [0,ffc], the solution bk exists 
uniquely in [0,^^]. ■ 
In the case where the variables are i.i.d., since V,}_-^^{y) < ?/ we have Wk > xp, and hence 
Vk = Xp, as given in Section [T] 

Lemma 6.2 For any sequence of nonnegative independent random variables X^, . . . , Xi the 

sequence bk,2 < k < n is monotone non-increasing. 
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Proof: We first show that 

V^^, < E[X,+, AV,% 2<k<n- 1. 

The right hand side is the value obtained by applying, on the sequence Xk+i, . . . ,Xi, the 
suboptimal two choice rule where X^+i is chosen as the first and second choice if X^+i < 
(this is the same as taking X^+i as the first choice and not taking any second choice), and 
when Xk+i > the optimal two choice rule is applied on X^, . . . ,Xi. The inequality refiects 
that the optimal rule does as well as this, or any other, two choice rule on this sequence. 
Therefore 

V,l,{h^i) = V,l, < E[X,^, A V,'] = E[X,+i A V,\h)] = V,lM. 

Since Vf}_^_^{x) is strictly monotone increasing in the interval [0,fjt4.i], which contains b^+i, 
the Lemma is shown. ■ 
Below we consider stochastic dominance between two random variables, and write Y <d 
X when PiY > t) < P{X > t) for all t. 

Lemma 6.3 Let X„, . . . ,Xi and Yn, ■ ■ ■ ,Yi be sequences of independent non-negative ran- 
dom variables having two choice value and threshold sequences Vj^,Vj^ and bf,bj,j = 
1, . . . , n respectively. If for some m>2, 

Y,<dX,, j = l,...,m, (77) 

and there exists r > max{6;^, 6^} such that 

r A Yj+i <dT A Xj+i for m < j < n, (78) 

then 

V,''<V/', forj = 2,...,n; (79) 

hence, if the inequalities in (|77| ) and are replaced by equalities, then Vj' = V^^, J = 
2,3, ... ,n. Finally, is unchanged upon replacing any X^+i by t A X^+i, 2 < j < n, for 
any r >b^ . 

Proof: Let V"^'^(x) and V^'^{x) denote the optimal one choice value functions for the X 
and Y sequences respectively, with guaranteed value x, as in ([T]). A simple induction using 
(fTTjl gives V^'^{x) < V^^'^(x) for all x and 1 < j < m. 

First suppose that (|7F?|) holds for some arbitrary r, and that for some m < j < n, 

Vl'\x) < Vf'\x) for all x<t. (80) 

Then for x < t, using that V^^'^(x) < x < t and V^'^{x) < x < r by Lemma f6. 11 we have 

Y,+iAV['\x) < Y,+iAVf'\x) = {Y,+iAT)AVf'\x) <d (X,+iAr)AV/''(x) = X,+iA\//''(x), 
giving 

V[4{x) = E[Y,+, A V[^\x)] < A Vf^'^ix)] = Vfjix), for x < r, 
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and thus (jHUj) holds for 1 < j < n. 

For r > max{6j^, bj} and j = m, Lemma [6.21 implies this inequality holds for m < j < n, 
and therefore, for instance, 

A bJ = A r) A bJ <d A r) A 6}' = A 6}'. 

Now note that (f77|) yields V^^ < Vj^ for 1 < j < m, so assuming this inequality for some j, 
m < j < n, we now have 

V}^i = E[V[''(Yhi) a V^^] = i^lV^^'^lV-.+i) A V['\bJ) A = E[V['\Y,^, A 6[) A 

< E[vl-\x,^, A 6f ) A < i5;[v;^'^(x,+i a 6[) a i^^ 

= A Vf'\bJ) A )] = i?[V}^'^(X,+0 A Vl-\bJ)] 

= E[Vf'\X,^,) A V^] < EiV/^'^iX,^,) A 

thus dZni) holds. 

To prove the final claim, let Yn, . . . ,Yi be the sequence where any number of variables 
Xj+1,2 < j < n have been replaced by Xj+i A r with r > bj . Note that (fTfjl and (f7H|) 
hold with equality, and hence so does (jHUj) . Clearly = ^ , so assuming = Vj^ for 
2 < j < n, we have, taking the non-trivial case of j for which l^+i = X^+i A r 

V,^i = i?[V,^'^(r,^.0Al^^]=E[V^^'^(X,+iAr)AV;n = i5[^''''(X^^^^^ 

= ElVf^'^iX^^^) A l^^'^(r) A Vf'\bf)] = E[Vf'\X,^,) A V^^'^(6f )] = V/i,.m 

Let now X„, . . . , Xi be i.i.d. as X with distribution function F satisfying the hypotheses 
of Theorem ll.il Without loss of generality we may assume that the function L in © satisfies 
limj-^o L{x) = 1, since if Fx{x) = x°'Lc{x) with lim^-jo Lc{x) = £ G (0, oo), then Z = C}I'^X 
has distribution function Fz{z) = z'^ilj C)Lc{Cr^l'^z) with Xmi^^Qilj C)Lc{li'^l'^z) = 1. 
Since = C^^^^V^ , we have 

Fz(V;^)=Fx(Vf), 
and hence we can assume that X has distribution function F such that 

F{x) = x^Lix) lim^|o^(a;) = 1- (81) 

Corollary 6.1 Let X„, . . . ,Xi be a sequence of i.i.d. non-negative random variables with 
-E[X2AXi] < oo and distribution function satisfying l\81]} . Then there exists an i.i.d. sequence 
Yn, ■ ■ ■ ,Yi of bounded non-negative random variables with distribution function satisfying iSl]) 
such that = for alln>2. 

Proof: Assume xp = oo, else there is nothing to prove. For all x > sufficiently small, 
using the non-degeneracy of the distribution F on [0,x], Jensen's inequality applied to the 
concave function ipi^u) = u Ax yields 

E[x A Xi] < X A EXi, with strict inequality for all x sufficiently small. 

Thus 

E[X2 A X1IX2] < X2 A EXi, with strict inequality having positive probability 
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and therefore, since V^/(oo) = EXi (which may be infinite), 

0<V2 = E[X2 A Xi] < E[X2 A EXi] = Vi{oo). 

Using xp = oo and Lemma Ifi.H V2{x) is continuous and strictly monotone increasing on 
(0, oo), hence the solution 62 to 

V2 = V2\X) 

exists, is unique, and satisfies < 62 < cc. 
For j = 1, . . . ,n and any K > b2 let 



Xj for Xj < b2 
K for Xj > 62- 



Using Lemma 16.31 with m = 2 and r = 62 ? we see that the two stop values of Xj, . . . , Xi 
and of Yj, . . . ,¥3, X2, Xi are the same for 2 < j < n, i.e. V^^ = V^{Xj, . . . , Xi) = 
V^(Yj, . . . ,¥3, X2, Xi). Since the distribution of Xj is unbounded, P{Xj > 62) > 0, which 
guarantees that K >h2 can be chosen to yield E\Y2 A Yi] = E[X2 A Xi]. But now, with the 
equality V^^(Yj-, . . . , Yi) = V^-^(l^-, . . . , "Ks, X2, Xi) between the optimal two stop values on the 
sequences indicated now true for j = 2 by choice of K, assuming it true for j > 2 and using 
the notation as in the proof of Lemma 16.31 yields 

V,^i = V^^,{Y,^,,...,Y,) = E[V]'\Y,^,)AVf 

= E[V['\Y,+,) A V^^(F„ . . . ,F3,X2,Xi)] = V^^+i(F,+i, . . .,Y,,X2,X,) = V^^^. 

Since P{Xj < x) = P{Yj < x) for all < x < 62, the distribution P{Yj < x) satisfies dHU) 
and the bounded i.i.d. sequence F„, . . . ,Yi has all the claimed properties. ■ 

We have the following Lemma. 
Lemma 6.4 Let X have distribution function F{x) = P{X < x), and set 

F^-^^u) = sup{x : F{x) < u} for < u < 1. 

Then 

F{x) > u if and only if x > F^^(u), (82) 
and with U ~ W(0, 1) we have 

X=dF-\U). (83) 

In addition, if 

F{x) = x°'Lf{x), for all X > 0, with lima-j^o -^^(2;) = 1, 
then there exists a function L* such that 

F~\u) = u^/'^Lp-iiu) = u^/"L*(?i^/"), with \imL*{u) = 1, (84) 

SO that by ( [^ , 

X =d f/^/°L*(f/^/"). (85) 
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Proof: Let Au = {x : F{x) < u}. If F{x) > u then x ^ Au and therefore F^^{u) < x. 
If F{x) < u then by right continuity there exists e > such that F{x + e) < u. Thus 
X + e G Au, which gives that F~^{u) > x + e > x. This demonstrates (j82|l . Now replacing u 
by a random variable U having the W[0, 1] distribution we obtain (jEHj), by P{F~^{U) < x) = 
P{U < F{x)) = F{x). 

The claim in (jH^ is equivalent to 

limi^lM)!^!. (86) 

ulO U 

Using that F{x) = x"Lf{x), 

F~^{u) = sup{x : x'^Lpi^x) < u}, 

and hence, setting La{y) = 

{F-\u))" = sup{a;" : a;"Lj.(x) < u} = sup{y : yLpiy^^") < u} = sup{y : yL^^iy) < u}. 

(87) 

Note yLa{y) = F{y^^°') is non-decreasing. Let e G (0,1) be given. Since limy^Q La{y) = 1, 
there exists 6 > such that 

1 - e < L^{y) < 1 + e for all < y < 5. (88) 

Let < M < (5(1 — e). Then if < y < ^/(l + e) we have y < S and so 

yLaiy) < y(l + e) < u, 

so 

: < y < u/(l + e)} C {y : yL^{y) < u}. 

Thus 

u/il + e) < (F-1(m))" for all < m < 5(1 - e). 
Now, with < u < 6{1 - e) and any y G {u/{l - e), 5), by (jHH|) . 

M < (1 - e)?/ < yL^iy), 

and it follows by (jHTj) that 

(F-^(t.))"<V(l-e)- 

Hence, 

1/(1 + e) < ^—^P^ < 1/(1 - e) forO<M<(5(l-e), 

and (jSni) is shown. ■ 

Lemma 6.5 Let Xn, n = 1,2, . . . be a uniformly integrahle non-negative sequence of random 
variables, and < Ln < L, L a constant, with Ln —>-p 1 as n oo. Then 

lim sup ExnLn = hm sup Exn 

n— >oo n— ►oo 

SO that in particular, if lim„^oo Exn exists, 

limsupExnLn = hm Exn- 
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Proof: Let e > be given. Since Xn is uniformly integrable, there exists 6 > such that 

EXn^A < e whenever P{A) < 6. (89) 
Since L„ — >-p 1 as tt, — »• oo, there exists uq such that for all n > uq 

fin = {\Ln — M < e} satisfies P(fi„) > 1 — 5. 
Hence, for n > no, using (j89|l and that Xn > 0, with A = 

(1 - e)Exnln^ < ExnLn < (1 + e)^Xnlc„ + Le < (1 + e)Exn + Le 

and 

Exn - e < ^Xnlf7„, 

so that for n > no we have 

(1 - e){Exn - e) < ExnLn < (1 + e)^Xn + Le. 
Taking limsup and recalling e > was arbitrary completes the proof. H 



Lemma 6.6 Let Xn, . . . ,Xi be an integrable i.i.d. sequence with distribution function F{x) 
satisfying Let = n^/^l// and W.f^" = n^/"V^'^\ Then 

limsupW^ < lim W^'^\ 
Proof: Using Lemma f6. 41 we construct i.i.d. pairs (Ui^Xi) with Ui r^lA^Xi F, and 

By Corollarv 16.11 without loss of generality we can take the X variables to be bounded, 
and since — > 1 as m | 0, it follows that L* is bounded. 

Let 2^^'" and 2^ be the optimal random n- variable two-stop value for the f/n^", . . . , Ul^"" 
and Xn, . . . ,Xi sequences respectively. Since En^/°'2^^'°' = n}/"Vn^^°' = W^^''°' converges 
(to hipa)), we have 

P(2r^" >e) = P(nV<^2r^" > n^'^e) < ^ - as n ^ oo. 

Hence 2^^^" 0, and therefore L*(2^^^") 1. Furthermore, by Corollary 15.11 the 
collection n^^°'2^^^°' has a bounded r*^ moment for some r > 1 and hence is uniformly 
integrable. 

Let 2^'^^" denote the X sequence stopped on the optimal rules for the U sequence. 
Then 2^'^^^" = 2^^^°' L*{2^^^"), and since these rules may not be optimal for the X sequence 
we have 

En'/^2^ < En^/-2^'^''" = En'/^2f^L*{2f"). 

Taking limsup and using that ni/"2f is uniformly integrable and L* is bounded and 
L*(2^^'^") -^p 1, the result follows from Lemma f6. 51 and the fact that W^^^" converges. ■ 
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Lemma 6.7 Let X„, . . . ,Xi be i.i.d. random variables with distribution function F satisfy- 
ing iSl]} . Then the indifference values bn for X satisfy 

lim bn = 0. 

Proof: Let V^^x) = V^^Xn, ■ ■ ■ , Xi, x) and V^{Xn, ■ ■ ■ , Xi) denote the optimal one stop 
value on X„, . . . ,Xi with and without the guaranteed bound of x, respectively. Note that 
trivially for A; = 1 we have that 

V^iXk, . . . , Xi; x) = V^iXk A X, . . . , Xi A x), 

and assuming it true for some k, 1 < k < n and using V^^X^, . . . ,Xi;x) = V^^(x) < x gives 

V,\,{X,+,, ...,X,;x) = E[X,^, A V,\X,, ...,X^; x)] = E[{X,+, A x) A V,\Xk, ...,X,; 
= E[{Xk+i Ax) A V,^{Xk Ax,...,XiAx)] = A x, . . . , Xi A x). 

Since bn is monotone non- increasing by Lemma f(j.2^ bn i b > 0, and we have 

V^iXn A 6, . . . , Xi A 6) = V,]ib) < = Vf . (90) 

Hence the two choice value on X„, . . . , Xi is greater (worse) than the optimal one choice 
value of the sequence of i.i.d. random variables b A X„, . . . ,b A Xi. If 6 > 0, by (0), the limit 
of the scaled optimal one choice value of this sequence, W^^'^'^ say, is the same as the limit 
of W^'^, the scaled optimal one choice value for X„, . . . , Xi. But then, using in the first 
inequality. Lemma Ifi.fil for the second inequality. Theorem 15.11 for the equality, (fKH|l for the 
strict inequality and the results of Kennedy and Kertz (1991) for the last two equalities we 
have 



x,i 

n 1 



lim W^^^ < lim sup VT^ < lim W^^'^'' = h{b^) < (1 + 1/a)^/" = lim W^^^'"^^ = lim 

n— >oo n— >oo n^oo n— >oo n— >oo 

a contradiction. ■ 

Lemma 6.8 Let {Ui,Xi), i = n,...,l be independent pairs of random variables with Ui 
uniform on [0, 1] and Xj having distribution function F satisfying ^El\) . Let Vn,m be defined 
as in ^EB), giving in particular Vn^n = Vn ■ Then for every e G (0, 1), there exists m such 
that 

< liminf < lim sup "'"^ < . (91) 



1 ~l~ C n— >oo Vn,n n— >oo '^n,n 1 C 

Proof: Using ()85|) of Lemma 16.41 we can construct the i.i.d. X sequence using an i.i.d. 
sequence f/^/" with distribution W° by defining Xj as 

X, = f///"L*(?7,'/") a.s. (92) 

where lim^jo -^*('") = 1- Hence, for the given e G (0, 1) there exists 5 > such that 

1 -e < L*(m1/") < 1 + e forO<M<(5, (93) 
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and so by and we have 

(1 + e)-^Xi < Ul'"" < (1 - eY^Xi when Ui < 6. 

By condition (jHT|) . F is continuous at and satisfies F{0) = 0, and therefore there exists 
p > with < F{p) < 6. But by (jHS), since 

Ui < F{p) if and only if Xi < p, 

we have 

if X,<p then U., < S. 

Let r = min{5, p}, and and b^^^°' be the indifference values for the X and [/^/" 
variables, respectively, which by Lemma 16.71 converge monotonically to zero. Hence there 
exists m with 

max{6^' ",b^} <T, 

and for all n > m, by Lemma [6.31 

(l + e)-V„(X„,...,Xi) 
= (1 + e)-'VniX^ At,..., X^+i At,X^,..., X,) 

= K((l + e)-\Xr. A r), . . . , (1 + e)-i(X„+i A r), (1 + e)-^X^, . . . , (1 + e)-^^!) 

< V;(f/y"Ar,...,f/^/^iAr,X^,...,XO 

= • • • , f^m+l5 • ■ ■ 5 -^l) 

= VniU'J'' AT,...,U'J^,AT,Xm,...,X,) 

< V;((l - e)-\X^ A r), . . . , (1 - e)-i(X^+i A r), (1 - e)-iX„, . . . , (1 - e)-'X^) 

< (1 - e)- A r, . . . , X^+i A r, X^, . . . , Xi) 
= (l-e)-iK(X„,...,Xi). 

Now dividing by „ we see that for all n > m. 



1 ^ ^n.m ^ 1 



1 + e K,n 1 - e 
completing the proof. 



Proof of Theorem ll.lt Clearly, for all < m < ra. 



Given e G (0, 1), let m be such that ()91|) holds. But for any fixed m we have by Theorem 
Othat 

lim 



Vn,0 



Hence by Lemma 



< iim mf — — < hm sup — — < 



and therefore the limit of the ratio exists and equals one. Applying Theorem 15.11 to the 
sequence n^^°'Vn.o completes the proof of Theorem ll.il ■ 
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7 Numerical Results and Additional Remarks 



In Table 1, for the a = 0.1, 0.2, ... 1, 2, ... 10 values in column (1), we tabulate the following 
quantities in the columns indicated: 

(1 + 1/a) 
h'^lba) = dl and 

r(i + i/a)°, 

for F{x) = x°'L{x) and limx^oL{x) = C existing in (0, oo). In columns (6), (7), and (8), 
we tablulate the ratios (3)/(4), (4)/ (5) and (3)/ (5). Note that another natural comparison 
would be among the values hsted raised to the power 1/a, as this would yield a comparison 
of the actual limiting values of /V^ / E{V^) and V^/E{V^) respectively. The reason 
that Table 1 lists the values in the way it does is to display them in a comparable order 
of magnitude to make numerical comparisons easier. The final column of Table 1 presents 
the relative improvement attained by using two stops rather than one, as compared to the 
reference value of the prophet, 

lim(K'-K')/(K'-V;^)- (94) 

n— >oo 

As evident from the table, the improvement is highly significant for all values of a. 
The following asymptotic results can be shown to hold: 
(i) For a oo, 

lim lim nF{V^) = 1 

a— >oo n— >oo 

lim lim nF{V^) = 1 - 1/e 



(2) 6„ 

(3) lim„^oonF(r„i) = 

(4) lim^^^nF{V^) = 

(5) lim™nF(FP) = 



lim lim nF(y^) = e~ 



a— >oo n~>cx> 



where 7 = .5772 ... is Euler's constant. The limiting value for the relative improvement (jMjl 
given in the last column is 

[l-log(e-l)]/7 = 0.7946... 

(ii) For a — > 0, 

The quantities in columns (3), (4) and (5) all tend to infinity, but the ratios in columns 
(6), (7), (8) and (9) tend to a finite limit, and are respectively 

lim lim «^<^"' - - 



nF(V'^) 

lim lim ^ = e/2 = 1.3591 

a^On^oo nF{Vn) 
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Table 1: Limiting Values of nF{V^),nF(y^),nF(y^), and their ratios. 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


(9) 


a 




\imnF{V^) 


\imnF{V^) 


\imnF{VP) 


(3)/(4) 


(4)/(5) 


(3)/(5) 


Eq. (jni 


0.1 


11.9312 


11.0000 


5.72334 


4.52873 


1.92195 


1.26379 


2.42894 


.99868 


0.2 


6.8927 


6.0000 


3.20772 


2.60517 


1.87049 


1.23129 


2.30311 


.97131 


0.3 


5.2004 


4.3333 


2.36372 


1.94980 


1.83327 


1.21229 


2.22245 


.93248 


0.4 


4.3485 


3.5000 


1.93919 


1.61670 


1.80488 


1.19947 


2.16490 


.90235 


0.5 


3.8342 


3.0000 


1.68310 


1.41421 


1.78242 


1.19013 


2.12132 


.88102 


0.6 


3.4896 


2.6667 


1.51157 


1.27776 


1.76417 


1.18298 


2.08699 


.86571 


0.7 


3.2423 


2.4286 


1.38853 


1.17940 


1.74902 


1.17732 


2.05916 


.85460 


0.8 


3.0561 


2.2500 


1.29590 


1.10506 


1.73624 


1.17270 


2.03610 


.84614 


0.9 


2.9107 


2.1111 


1.22362 


1.04684 


1.72530 


1.16887 


2.01665 


.83958 


1.0 


2.7940 


2.0000 


1.16562 


1.00000 


1.71583 


1.16562 


2.00000 


.83438 


2.0 


2.2634 


1.5000 


0.90214 


0.78540 


1.66270 


1.14864 


1.90984 


.81217 


3.0 


2.0839 


1.3333 


0.81309 


0.71207 


1.63983 


1.14186 


1.87245 


.80556 


4.0 


1.9934 


1.2500 


0.76825 


0.67497 


1.62707 


1.13820 


1.85193 


.80252 


5.0 


1.9388 


1.2000 


0.74123 


0.65255 


1.61895 


1.13590 


1.83897 


.80078 


6.0 


1.9023 


1.1666 


0.72316 


0.63753 


1.61324 


1.13432 


1.82994 


.79967 


7.0 


1.8762 


1.1429 


0.71023 


0.62677 


1.60914 


1.13317 


1.82343 


.79892 


8.0 


1.8566 


1.1250 


0.70052 


0.61867 


1.60592 


1.13230 


1.81839 


.79831 


9.0 


1.8412 


1.1112 


0.69296 


0.61236 


1.60350 


1.13162 


1.81455 


.79789 


10.0 


1.8291 


1.1000 


0.68689 


0.60731 


1.60147 


1.13105 


1.81134 


.79756 



nF(V^) 

lim lim = e = 2.7182 . . . 

a^On^oo nF{Vn) 

The relative improvement given in the last column can be shown to tend to 1. 



Remark 7.1 Though we have proven Theorem M . l\ for the case where F{x) = x°'L{x), a > 
and L{x) having finite positive limit as x I 0, we believe it holds true for all F G 'D{G'^) of 
that is, whenever L{x) is slowly varying as x I 0. 

Remark 7.2 The approach in the present paper can easily be applied to obtain the asymp- 
totic behavior of the one-choice value (obtained in Kennedy and Kertz (1991) by a different 
method), when F{x) = x^L{x) and limj-io L{x) = £ G (0, oo). First assume that X ~ U^i^x) 
as in / f7^) . Then for the one choice value V^, we have 

KVi = E[X A V^] = a / x'^dx + (1 - {V^TWl 

Jo 
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Set = n^^^Vjl, and make the change of variable y = nx", as in Section 2. Now multiply 
by n^/" to obtain 



n + l n 



W^nV = - / y''-dy+{l-{V^r)Wl 



- / {WlAy"'')dy. 



n 



Thus satisfies with q{y) = y^^", and now Theorem \4. 1\ can be applied to yield that 
— >■ q{b) where b is the unique root of 



\^'''du + {l/a-y)y^''' = 0, 



giving 6 = 1 + \/a. Hence, lim„^oo W^ri = (1 + or, lim„^oo ''^-^'(V^^) = (1 + 1/a). 

The general result for the wider class of distribution functions mentioned now follows in a 
manner similar to, but simpler than, the calculation for two choices. 

Remark 7.3 A similar approach can also be used to obtain the limiting value for more than 
2 choices. For three choices one must first obtain the function h^^\y) which replaces the 
function h^^\y) = h{y) of (8). (Note that by RemarkVTR h'^^\y) = y^'"). 



Remark 7.4 Our results translate easily to the case where the statistician is given two 
choices and his goal is to pick as large a value as possible, his payoff being the expectation 
of the larger of the two values chosen. Denote the optimal two-choice value based on n i.i.d. 
observations by V^. Then for X ~ F{x), where xp < oo, and 

Fx{x) = 1 — {xf — x)°'L{xf — x) 
where L(-) satisfies limy^QL^y) = C and < C < oo, we have 

limn[l-F(K2)] = /i"(6,). 



8 Final Remarks 

The last two authors are very saddened to announce that our invaluable colleague and friend 
David Assaf passed away most suddenly on December 23'"'^ 2003 as this work was nearing 
completion. On that very day, in a last email from Prof. Assaf to us regarding the final 
touches on this manuscript, he wrote that he had some ideas and 'I will say more on this 
in a few days.' We regret on many levels that this work can now only remain more or less 
in its current form, without the benefit of those further comments, now forever lost, which 
would have certainly greatly improved the work. 
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